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Differentiable Generalized Inverses 
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Necessary and sufficient conditions are given for a differentiable matrix to have a differentiable 
generalized inverse. It is shown that when these conditions are met there exist, for several classes 
of generalized inverses, a differentiable generalized inverse which coincides with a prescribed gen- 
eralized inverse on a particular subset. The relations between the derivative of a matrix and that of a 
differentiable generalized inverse are given. 
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1 . Introduction 

If A is a nonsingular matrix the entries of which are difTerentiable functions of t, then the 
familiar relations between the derivative of A and that of A x are 
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If A is a singular (either rectangular or square with zero determinant), differentiable matrix and B 
is a differentiable generalized inverse of A, we inquire what relations analogous to (1) and (2) hold 
between the derivatives of A and B. 

In section 3, necessary and sufficient conditions are given for the existence of a differentiable 
generalized inverse of a differentiable matrix. When these conditions obtain, we consider, in sec- 
tion 4, the problem of the existence of a differentiable generalized inverse which coincides with a 
prescribed generalized inverse on some particular subset. Moreover, this problem is considered 
for several classes of generalized inverses. 

In section 5 relations between the derivative of a matrix and that of a differentiable general- 
ized inverse are given. These relations depend upon the class of generalized inverse and reduce, 
in the nonsingular case, to (1) and (2). Further, necessary and sufficient conditions are given such 
that (1) and (2) remain valid in the singular case when A ~ ] is replaced by a differentiable generalized 
inverse. Finally, in section 6, some special cases are considered. 

2. Preliminaries and Definitions 

All matrices are considered to have complex entries. For any matrix M, we denote by p(M), 
R(M), N(M) and M* the rank, range, null space and conjugate transpose, respectively, of M. If 
a function / is such that its first k derivatives exist and are continuous we write /e^ A , and the 
interval on which this is true will be clear from the context. If the entries mij of M are such that 
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rrijjeffl', for all i, j, we write Me9o k . If /is a function defined on a subset <g of an interval [a, b] , a 
function g defined on [a, 6] is said to be an extension of f to [a, b] if g(t) =f(t) whenever tec?. 
We apply this definition to both scalar-values and matrix-values functions. 1 

We deal here with the same classes of generalized inverses previously defined [3] 2 and 
employ the same definition of a strict generalized inverse of a given class as that given in [3] . 

3. Existence of Differentiate Generalized Inverses 

We begin this section with the following lemma. 

Lemma 1. A continuous projection defined on an interval has constant rank. 

PROOF. Let A(t) be a continuous projection defined on an interval <g of the real line, and 
let p(A(t)) = r(t). Then clearly the determinant det (A + I)=2 r{t) . The left-hand side of this 
equality is continuous. But a continuous integered-valued function on a connected set is constant. 
It follows that p(A(t)) is constant. 

If A is a given matrix, it is known [2] that there exist matrices BeC\(A) which commute with 
A if and only if p(A) =p(A 2 ) and that when this condition is met there exists a unique C2-inverse 
which commutes with A; it is in fact a polynomial in A. The next lemma concerns the differenti- 
ability of this generalized inverse. 

LEMMA 2. Let Ae^ k on an interval % and have the property that p( A(t)) = p(A 2 (t)) = r for each 
\e<o. If B(t), for each te^f, is the unique C2-inverse of A(t) which commutes with A(t), then Be^ k on &. 

PROOF. From p(A) = p(A 2 ) we have that the Jordan canonical form of A(t) is diag (A\(t) , 0), 
where A\(i) is an r-square nonsingular matrix. The characteristic polynomial of A(t) has coef- 
ficients in 9o k and is of the form \ n ~ r f{\), where /(A.) is the characteristic polynomial of A\{t) . 
From /(A) we can construct a polynomial p (A), with coefficients in^ k , such that A~ A {t) = pC^iU)). 
Now the matrix B\{t) =p(A(t)) is, by a known theorem [1], a Ci-inverse of A (t) since the Jordan 
form of AB\ is the projection diag (/,-, 0). The matrix B = B\AB\ is, by Theorem! llof [3] a C 2 -inverse 
of A, commutes with A, and clearly Beffi. 

We now employ Lemmas 1 and 2 to prove the main result of this section. 

THEOREM 1. Let Ae^ k on an interval ff. If p(A) is constant on &> then the Converse of A is 
in ^ k on % \ If p(A) is not constant on &, then no Ci-inverse, 1 ^ i ^ 4, can be continuous on % \ 

PROOF. If p(A) is constant on §f, then the Hermitian matrix H = A*A meets the conditions 
of Lemma 2. We are thus assured of a matrix W(t) which is the unique C 2 -inverse of H(t) which 
commutes with H(t) , and We% k on g 7 . Moreover, W is Hermitian [2] . But WE = HW and WeC 2 {H) 
imply WeC 4 {H). By Theorem 1 of [3],B=WA* is the Converse of A and clearly Betf k . Now let 
B be any C,-inverse of A, 1 ^ i ^ 4. If B is continuous on g 7 then, by Lemma 1, the continuous 
projection AB has constant rank on &. But by a known theorem [6], p{AB) =p(A), and A has 
constant rank. 

4. Extension of a Given Generalized Inverse to a Differentiable Generalized Inverse 

Suppose that Ae^ k on [a, 6], p(A) is constant on [a, b] and that for some subset & of [a, b] 
there is defined a matrix Bj which is in C\(A) on if for some 1 ^ i ^ 4. If there is an extension 
of Bj to all of [a, 6] which is in ^ k and which is a Converse of A on [a, b] then evidently each 
entry of Bj has an extension to all of [a, b] which is in c € k . The converse of this statement is the 
content of the next theorem. 

THEOREM 2. Let A, Bj, % and [a, b] be as above. If every entry of Bj has some extension to all 
of [a, b] which is in ^ k , then there exists a Bj which is an extension ofB[ to [a, b] and such that 
Bi€^ k and BieCi(A) on [a, b]. 

PROOF. For the case i = 4 we have no need for the theorem. For, the Converse is unique and 
is, by Theorem 1, in ( € k . 



1 In what follows we deal with closed intervals. The proofs given go through, with minor modification, for intervals which are half-open, open, semi-infinite. 
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110 



Let i=l. By hypothesis there is an extension B x of B\ and B\*f€ k . Let B + be the Converse 
of A, and let Ph = AB + , P\=I — BA. Then P R and P v are in ^ k and are projections onto R(A) 
and N(A), respectively. If D = B\ — B + , then £) is, on If, the difference between two matrices 
in C,M). Then B { = B + + PyDP H + D(I - P H ) is, by Theorem 2 of [3] , a G-inverse on all of [a, b] 
such that £,=£, on g 7 . Clearly 5,e^ k . 

Let & = 2. By what we have proved so far, we may take B 2 as an extension of B 2 such that 
B>eCi(A) and B 2 e^ k on [a, b]. Then, by Theorem 2 of [3], B 2 = B 2 AB 2 is a C 2 -inverse of A 
on [a, b~\. Clearly B 2 = B 2 on If and B 2 e9o k on [a, 6]. 

Let i — 3. By the first part of this proof we may take B 3 as an extension of fi 3 such that B 3 eC\ (A ) 
and B 3 e^ k on [a, 6]. Then, by Theorem 2 of [3], B 3 = B^AB + , where B + eC 4 (A), is a C 3 -inverse 
otA on [a, 6] and B 3 = B S on ^. Evidently B^ k on [a, 6]. 

The proof for i = 3' is an obvious parallel of that for i = 3. 

If ;4 is a differentiable EPr matrix we may inquire as to existence of a differentiable EPr 
CVinverse of A, where of necessity i ^ 2, for by a known theorem if BeC\{A) then BeC 2 (A) if and 
only if p(B) = p(A) [1,6]. This question is settled by Corollary 1. 

COROLLARY 1. Let Ae^ K be an EPr matrix on [a, b] and let B be an EPr C 2 -inverse of A 
on a subset & of [a, b]. // every entry of B has an extension to [a, b] which is in ( £ k , then there 
exists a B which is an extension of B to [a, b] and such that, on [a, b], Be^ k , BeC 2 (A) and B is 
EPr. 

PROOF. Let BeC 2 (A) be the extension of B given by Theorem 2. Then by Theorem 3 of 
[3], B = BA*B* is a CVinverse of A and is EPr on [a, b]. By the same theorem, B = B on %. By 
construction, B is clearly in c € k . 

It is an easy result from Theorem 1 that if on [a, b] A is a differentiable EPr matrix, then 
the Converse B of A is a differentiable EPr matrix. For, Theorem 1 shows that Be ( & k whenever 
Ae^ k and it follows from a known theorem [5] that B is EPr. Further, if A is EPr, then p{A) = p(A 2 ) 
= r [4], and if Ae^ k , A meets the conditions of Lemma 2. But by Lemma 6 of [3], the matrix 
vouched for by Lemma 2 is the Converse of A. Thus we can so far assert that, trivially, a differ- 
entiable EPr matrix has a differentiable EPr generalized inverse of every class, for it has a dif- 
ferentiable EPr Converse. The question of the existence of differentiable matrices which are 
at some points on [a, b] strict EPr C 2 -inverses of a differentiable EPr matrix is cared for by Theo- 
rem 7 of [3], which gives properties of the map \\)(B)=BA*B* (where A is EPr and BeC 2 (A)) 
upon which Corollary 1 is based. 3 

5. The Derivative of a Generalized Inverse 

In this section we denote by M' the derivative of a differentiable matrix M. We assume the 
existence of a differentiable generalized inverse, B, of a differentiable matrix A and study the 
relations which obtain between A' and B' . If B is any generalized inverse of A we define, through- 
out this section, the projections 

E,=AB (3) 

E 2 = BA. (4) 

Then ABA = E X A = AE 2 = A shows that E X {E 2 ) is a left (right) identity element for A. If BeC 2 {A), 
then BAB = B = E 2 B = BEi shows that E 2 (Ei) is a left (right) identity element for B. Relations 
(1) and (2) stem from the fact that the derivative of AA 1 =A l A = 1 is zero. In a somewhat analo- 
gous manner the relations derived in what follows stem from Lemma 3. 

LEMMA 3. IfE is a differentiable projection, then EE'E = 0. 

PROOF. From E = E 2 we have E' = E'E J rEE'. Left multiplication of this last equality by E 
gives EE' = EE'E-\-EE', from which the result follows. 



3 We observe that by the last display of the proof of Theorem 5 of [3] and by Theorem 7 of [3], the set C 2 (A) —Cy{A) is empty if and only if A is nonsingular. 
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The next theorem furnishes an analog of (1) for a differentiable C\ -inverse and an analog of 
(2) for a differentiable C 2 -inverse. 

THEOREM 3. If A is differentiable and B is any differentiable Ci-inverse of A then 

EiA'E 2 = -AB'A (5) 

and if B is a differentiable C 2 -inverse then also 

E.B'E^-BA'B. (6) 

Proof. If BeC x {A), then EiA=A. By Lemma 3 we have that E X E[A = EiE[E x A = 0. This 
being so, we have, using (3) and (4) EiE[A= E X (A'B + AB')A=E l A'E 2 + AB'A = 0, from which 
(5) follows. If BeC 2 (A), then multiplication of (5) from left and right by B and using E 2 B = BE\ =B 
gives (6). 

We observe that (2) can always be obtained from (1) and conversely. But, as seen from the 
proof of Theorem 3, (6) follows from (5) only if BeC 2 (A), i.e., only if BeC\(A) andAeCi(B). 

The next theorem gives conditions under which a differentiable Ci-inverse of A can be sub- 
stituted for A 1 in (1) and conditions under which a differentiable C 2 -inverse of A can be sub- 
stituted for A -1 in (2). An example is given in the next section. 

THEOREM 4. If A is differentiable and B is a differentiable Ci-inverse of A, then A' = — AB'A 
if and only if E1A=AE 2 = 0. If B is a differentiable Co-inverse of A, then B'= — BAB if and 
only if E!>B = BE! = 0. 

Proof. If E '[A = AE 2 = 0, then from A = E X A=AE 2 we have A' = E X A' = A'E 2 . But then (5) 
reads A' = — AB'A. Conversely, if A' = — ABA, left multiplication by E\ shows E\A' = A' and right 
multiplication by E 2 shows A'E 2 = A'. It now follows from A' = E[A + E\A' =AE 2 +A'E 2 that 
E[A=AE 2 = 0. Similarly, if B is a CVinverse of A, then B = E 2 B = BE 1 and E' 2 B = BE[ = together 
imply B' =E 2 B' = B'E X and (6) becomes B' = — BA f B. Conversely B' = — BA'B implies B' = E 2 B' 
= B'E l which implies E 2 B' = BE[ = 0. 

If A is m X n, thenEi and E 2 are m-square and n-square respectively. In the event that p(A) = m 
we have E\ = I m and Theorem 4 becomes A' = — AB'A if and only if AE 2 = when BeCi(A) and 
B' = — BA'B if and only if E 2 B = when BeC 2 (A). Similar statements hold when p(A)=n. The 
nonsingular case (p(A) = m = n, E\ — E' 2 = 0) is clearly a special case of Theorem 4. 

6. Special Cases 

Let A be a matrix such that P l AP= diag (7(0 , Jo) where P is a constant matrix, J (t) is the 
Jordan block corresponding to the nonzero roots of A, Jo is the Jordan block corresponding to the 
zero roots of A. Assume that the structure of the Jordan form remains the same over some ^-interval 
over which A is differentiable. It is easily verified that if P l BP= diag C/ -1 M> /o)> where 7J is the 
transpose of Jo, then B is a C 2 -inverse of A. For, J is a direct sum of nilpotent blocks, each block 
having l's on the subdiagonal and zeroes elsewhere. For any such block /V of order k, A^W=diag 
(h--i , 0) which is idempotent and has the same rank as N. By a known theorem [1], A^ r is then a C 2 - 
inverse of A^ and hence Jl is a C 2 -inverse of Jo. Now BA is similar to diag (/, JIJ) and by the same 
theorem [1]; B is a CVinverse of A. In this case then, E\ = P diag (/, JoJl)P~ l and E 2 = P diag 
(/, JqJo)P~ 1 are constant matrices and Theorem 4 applies. 

If B is a CVinverse of A and commutes with A, then E\ — E 2 . Further, since A, B, E\ and E 2 
all have the same rank [1, 6], it follows that A and B have the same null space and that A* and 
B* have the same null space. Given this, the two conditions E\A= AE 2 = and E 2 B = BE[ = 
are equivalent. For, the first requires that the columns of E' = E[ = E 2 be in N(A) and that the 
columns of (£")* be in A^*); while the second requires that the columns of E' be in N(B) and 
that the columns of (£')* be in N(B*). 
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Thus if BeC 2 (A), is differentiable, and commutes with A, we have from Theorem 4 that if 
either of the conditions A' = — AB'A and B' = — BAB is satisfied the other is also satisfied. 

We have shown in section 4 the existence of a differentiable EPrCz'mverse of the differentiate 
EPr matrix. It is known [1] that an arbitrary square matrix possesses a C2-inverse which is EPr. 
The next example shows a matrix which can have no continuous real CVinverse which is EPr. 
Let A be 



A 



cos t sin t 




on the interval if =[0, it]. Then p(A) = 1 on if and clearly A is differentiable there. Let BeCziA) 
and N(B) = N(B*). We now show that B is not continuous. Since [6] p{BA) = p(A) = 1, on if, we 
have that BA ¥^ 0, for tejg and that the first column, 6i, of Z? is not zero for £e<?f. But ZL4 t^ implies 
= R(A) N(B)=R{A) -N(B*)=R(A) • R(B)^. Then since the vector*, where ** = [1, 0], is a 
basis for R(A), R(A) R(By = implies that if y* = [0, 1], then yiR(B). Since 6i # 0, for teg\ 
is a basis for R(B) we now have that bu, the first entry of b u is never zero for tec?. We also have 
p(AB) = p(B) = 1, on g 7 , so that C = AB #0, for £e<^, and in particular cn(0 = b n (t) cos £ + 6 2 i(0 
sin £ 7^ 0, for £€<?f. Now assume that b u is continuous on %. Then Cn(0) and Cn(7r) have opposite 
signs, since b\ \ cannot change signs on if. But then Cu (t ) =0 for some te<?, which is a contradiction. 
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